Determinants of the control of dynamic systems: The role of structural knowledge

In educational and organisational settings it has become common practice to use computer-based complex problems that represent dynamic systems for assessment and training purposes. In the interpretation of performance scores and the design of training programs, it is often assumed that the capacity to effectively control the outcomes of a dynamic system depends on the acquisition of structural knowledge. Control performance scores are generally interpreted as evidence of individual differences in the capacity to acquire and utilise structural knowledge and training programs typically try to improve learners‘ mental models of the system of interest. However, a causal relationship between the acquisition of structural knowledge and successful system control has not been established, and some findings suggest that it may be possible to control dynamic systems in the absence of structural knowledge. Therefore, the goals of this project were to determine the conditions that are required to learn how to control dynamic systems and the psychological processes that separate successful from less successful problem solvers in the performance of this task. The main emphasis of this investigation was to clarify the role of structural knowledge in the control of dynamic systems and to identify sources of individual differences in problem solvers‘ capacity to acquire such knowledge and apply it in a goal-orientated application. In a series of studies, a combined experimental and differential approach was adopted to address these goals. This consisted of the experimental manipulation of the task and structural characteristics of complex problems combined with the use of process indicators and external psychometric tests. Study 1 examined whether problem solvers need to directly interact with a dynamic system in order to acquire structural knowledge that is useful for system control. Study 2 examined whether increments in structural knowledge lead to improvements in control performance and whether dynamic systems can be successfully controlled without structural knowledge. Study 3 examined whether the relationship between structural knowledge and control performance is moderated by system complexity. Each of these studies also investigated the role of fluid intelligence in the acquisition and application of knowledge. Additional methodological contributions include the application of Cognitive Load Theory to the design of the instructions used to manipulate structural knowledge, the use of randomly generated control performance scores to evaluate the success of performance and the development of a theoretically driven operationalisation of system complexity. Across the studies, it was found that structural knowledge was a necessary condition of better than random performance and that there was a causal relationship between structural knowledge and control performance. However, the likelihood that structural knowledge would be acquired and utilised was found to be dependent on the complexity of the system. Small increments in system complexity resulted in floor effects on performance. Fluid intelligence was found to play a crucial role in the acquisition and subsequent application of knowledge. Overall, the results indicate that the complexity of the system determines the amount of knowledge that is acquired by the problem solver, which in turn, combined with their intelligence, determines the quality of their control performance

End-user experiences with two incident and injury reporting systems designed for led outdoor activities - challenges for implementation of future data systems

Background: Injury and incident (near miss) prevention is heavily dependent upon robust and high-quality data systems. Evaluations of surveillance systems designed to report factors associated with incidents and injuries are essential to understand their value, as well as to improve their performance and efficiency. Despite, this there have been few such evaluations published in the peer-review literature. Methods: The attitudes and experiences of industry representatives who used one of two variants of an incident and injury surveillance system to collect injury and incident data for the led outdoor activity setting were obtained through an online self-report survey following a 12-month trial. Survey respondents were 18 representatives of 33 organisations who were users of a comprehensive incident reporting and surveillance system - the Understanding and Preventing Led Outdoor Accidents Data System Software Tool (UPLOADS-ST) - and six out of 11 users of a modified system (UPLOADS-Lite). The survey collected information on user experiences in relation to system training, accessibility, ease of use, security, feedback and perceived value to the sector of collating and reporting data across organisations. Findings: Only four UPLOADS-ST responding users found the system easy to use and just three considered entering incident reports to be easy. However, many considered the training on reporting incidents to be sufficient and that the incident reports contained relevant details. Fewer than half of respondents (seven for UPLOADS-ST, three for UPLOADS-Lite) believed entering data was a good use of staff time and resources. Nonetheless, a majority of respondents (seven for UPLOADS-ST, five for UPLOADS-Lite) found the reporting format easy to read and felt the information provided was useful for their organisation. Conclusions: Usability barriers to incident reporting were identified, particularly for UPLOADS-ST, including time constraints and user friendliness. The majority of users believed aggregating and reporting incident and injury data across organisations would be of value in making the led outdoor activity sector safer. Improving the utility of the surveillance systems will assist in ensuring their sustainability in the led outdoor activity sector

Heat and sun related medical concerns in Australian led outdoor activities: a three-year prospective study

Active participation in the outdoors is beneficial for health and wellbeing. However, the impact of extreme weather, particularly heat, on safe participation is causing concern for organisations who lead these activities. Local mitigation strategies and acute management of heat- and sun-related illness (HSRI) are generally well understood by researchers and medical practitioners, however, cases continue to occur so further understanding of why this happens is required. This study aimed to identify the number, nature and contributory factors of HSRI in Australian led outdoor activities in order to seek opportunities for their prevention. This study presents a descriptive analysis of contributory factors to HSRI occurring during led outdoor activities. Cases were prospectively collected across 3 years (2014-2017) from a national Australian incident reporting system. Cases were included by identification of keywords linked with sun or heat exposure. From 2,015 incident cases, 48 cases were included: 25 termed heat stroke and 23 as “other adverse outcomes related to sun or heat.” One in three (35%) cases occurred during outdoor walking or running, and one in four occurred while camping. A total 146 contributory factors were identified. These factors were attributed to the activity participant (e.g. competence, decision making); equipment and resources (e.g. food/drink, dehydration); and environment (e.g. hot weather.). Mild to moderate HSRI was identifiable by signs/symptoms. Contributory factors were linked to the individual participant. Potentially, these factors could be mitigated through system focused approaches. Awareness of wider responsibility for preventing HSRI should be promoted across led outdoor activities

Injury causation in the great outdoors: A systems analysis of led outdoor activity injury incidents

Despite calls for a systems approach to assessing and preventing injurious incidents within the led outdoor activity domain, applications of systems analysis frameworks to the analysis of incident data have been sparse. This article presents an analysis of 1014 led outdoor activity injury and near miss incidents whereby a systems-based risk management framework was used to classify the contributing factors involved across six levels of the led outdoor activity 'system'. The analysis identified causal factors across all levels of the led outdoor activity system, demonstrating the framework's utility for accident analysis efforts in the led outdoor activity injury domain. In addition, issues associated with the current data collection framework that potentially limited the identification of contributing factors outside of the individuals, equipment, and environment involved were identified. In closing, the requirement for new and improved data systems to be underpinned by the systems philosophy and new models of led outdoor activity accident causation is discussed.© 2013 Elsevier Ltd. All rights reserved.C

Lost in translation: the validity of a systemic accident analysis method embedded in an incident reporting software tool

ABSTRACT Despite the proposed advantages of systems accident analysis (SAA) methods for understanding incident causation, they have not been widely adopted by practitioners. The aim of this study was to evaluate the criterion-referenced validity of an SAA method embedded within an incident reporting software tool. Thirteen practitioners used the tool to collect and analyse incident data within their organisation. The incident data were then analysed by researchers experienced in using the SAA method. Overall, there were low levels of agreement between participants and researchers regarding the identification and classification of factors and relationships. The findings indicate the systems thinking principles underpinning the SAA method may have been ‘lost in translation’, in that participants often identified only one or two factors and showed a poor understanding of how to identify relationships between factors. The methodological developments required to ensure that practitioners can validly apply the SAA method are discussed

Causal factors of hot air ballooning incidents: Identification, frequency, and potential impact

Background: Hot air ballooning incidents are relatively rare, however, when they do occur they are likely to result in a fatality or serious injury. Human error is commonly attributed as the cause of hot air ballooning incidents; however, error in itself is not an explanation for safety failures. This research aims to identify, and establish the relative importance of factors contributing towards hot air ballooning incidents. Methods: Twenty-two Australian Ballooning Federation (ABF) incident reports were thematically coded using a bottom up approach to identify causal factors. Subsequently, 69 balloonists (mean 19.51 years’ experience) participated in a survey to identify additional causal factors and rate (out of seven) the perceived frequency and potential impact to ballooning operations of each of the previously identified causal factors. Perceived associated risk was calculated by multiplying mean perceived frequency and impact ratings. Results: Incident report coding identified 54 causal factors within nine higher level areas: Attributes, Crew resource management, Equipment, Errors, Instructors, Organisational, Physical Environment, Regulatory body and Violations. Overall, ‘weather’, ‘inexperience’ and ‘poor/inappropriate decisions’ were rated as having greatest perceived associated risk. Discussion: Although errors were nominated as a prominent cause of hot air ballooning incidents, physical environment and personal attributes are also particularly important for safe hot air ballooning operations. In identifying a range of causal factors the areas of weakness surrounding ballooning operations have been defined; it is hoped that targeted safety and training strategies can now be put into place removing these contributing factors and reducing the chance of pilot error

Do not blame the driver : A systems analysis of the causes of road freight crashes

Although many have advocated a systems approach in road transportation, this view has not meaningfully penetrated road safety research, practice or policy. In this study, a systems theory-based approach, Rasmussens's (1997) risk management framework and associated Accimap technique, is applied to the analysis of road freight transportation crashes. Twenty-seven highway crash investigation reports were downloaded from the National Transport Safety Bureau website. Thematic analysis was used to identify the complex system of contributory factors, and relationships, identified within the reports. The Accimap technique was then used to represent the linkages and dependencies within and across system levels in the road freight transportation industry and to identify common factors and interactions across multiple crashes. The results demonstrate how a systems approach can increase knowledge in this safety critical domain, while the findings can be used to guide prevention efforts and the development of system-based investigation processes for the heavy vehicle industry. A research agenda for developing an investigation technique to better support the application of the Accimap technique by practitioners in road freight transportation industry is proposed.</p

Communication in the workplace : Defining the conversations of supervisors

Background: Communications plays a central role in promoting the health and wellbeing of workers. Although much literature has shown the positive benefits of safety communication in the workplace, research has yet to explore the nature of these communication practices within supervisor–worker relationships. This study overcomes this gap in the literature through objectively monitoring communication within the daily working lives of work-group supervisors in one organization. Aims: The aims of the research were to: (a)categorize communication in the workplace into three categories, namely task-related communication, relationship-related communication, and safety-related communication; and (b)explore the frequency of these dialogs. Method: We periodically recorded brief snippets of ambient (acoustic)sounds in supervisors' workplace environment by using an Electronically Activated Recorder (EAR). The EAR was run on an Apple iPod, with an application downloaded for free on iTunes (i.e., iEAR). The EAR was programmed to record for 30 s every three minutes for eight working hours a day of a five-day working week. Results: A total of 12.38 h of acoustic sounds from five workgroup supervisors was useable for coding. The results found examples of task-related (productivity, efficiency, workflow, and human resources)communication, as well as relationship-related (greetings, personal life discussions, workplace relations), and safety-related communication. We also found that the majority of the communication recorded was task-related communication compared with relationship-related and safety-related communication. Practical applications: This research provides preliminary insights into communication practices in the workplace and avenues for future research.</p

Learning from crashes : A systems approach to crash investigation in road freight transportation

No abstract available

Musculoskeletal disorders in the workplace : Development of a systems thinking-based prototype classification scheme to better understand the risks

Although there is a substantial body of literature describing the factors that contribute to musculoskeletal disorders (MSD) in the workplace, much of this research has focused on individual component failures, ignoring the factors influencing behaviour and decision-making. This gap in knowledge presents a challenge for practitioners wishing to understand the full range of factors contributing to MSDs and in the development of targeted intervention to mitigate the risk. This study conducted a systematic review of the literature to synthesis and summarise the evidence relating to the risk factors associated with MSDs. The risk factors identified informed the development of a prototype MSD risk factor classification scheme which was used to highlight gaps in current evidence. The resulting classification scheme identified multiple risk factor categories across six system levels. Several gaps in current evidence were identified which provide support for a research agenda focused on identifying additional sources of data to further understand the complex system of factors influencing MSD risk in the healthcare industry.</p